Using Active Learning Methods to Strategically Select Essays for Automated Scoring
نویسندگان
چکیده
Research on automated essay scoring has become increasing important because it serves as a method for evaluating students' written-responses at scale. Scalable methods written responses are needed students migrate to online learning environments resulting in the need evaluate large numbers of written-response assessments. The purpose this study is describe and three active than can be used minimize number essays that must scored by human raters while still providing data train modern system. uncertainty-based, topological-based, hybrid method. These were select included part Automated Student Assessment Prize competition then classified using model was training with bidirectional encoder representations from transformer language model. All produced strong results, topological-based producing most efficient classification. Growth rate accuracy also evaluated. different levels efficiency under sample size allocations but, overall, all highly classifications similar one another.
منابع مشابه
Argument Mining for Improving the Automated Scoring of Persuasive Essays
End-to-end argument mining has enabled the development of new automated essay scoring (AES) systems that use argumentative features (e.g., number of claims, number of support relations) in addition to traditional legacy features (e.g., grammar, discourse structure) when scoring persuasive essays. While prior research has proposed different argumentative features as well as empirically demonstra...
متن کاملAutomated Essay Scoring Using Machine Learning
We built an automated essay scoring system to score approximately 13,000 essay from an online Machine Learning competition Kaggle.com. There are 8 different essay topics and as such, the essays were divided into 8 sets which differed significantly in their responses to the our features and evaluation. Our focus for this essay grading was the style of the essay, which is an extension on the stud...
متن کاملAutomated Scoring of Handwritten Essays Based on Latent Semantic Analysis
Handwritten essays are widely used in educational assessments, particularly in classroom instruction. This paper concerns the design of an automated system for performing the task of taking as input scanned images of handwritten student essays in reading comprehension tests and to produce as output scores for the answers which are analogous to those provided by human scorers. The system is base...
متن کاملScoring Essays Automatically Using Surface Features
Surface features of essays include nonlinguistic characteristics such as total number of words per essay (essay length), sentence length, and word length as well as linguistic characteristics such as the total number of grammatical errors, the types of grammatical errors, or the kinds of grammatical constructions (e.g., passive or active) that appear in an essay. This study examines the feasibi...
متن کاملInvestigating Active Learning for Short-Answer Scoring
Active learning has been shown to be effective for reducing human labeling effort in supervised learning tasks, and in this work we explore its suitability for automatic short answer assessment on the ASAP corpus. We systematically investigate a wide range of AL settings, varying not only the item selection method but also size and selection of seed set items and batch size. Comparing to a rand...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Educational Measurement: Issues and Practice
سال: 2022
ISSN: ['1745-3992', '0731-1745']
DOI: https://doi.org/10.1111/emip.12537